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Abstract 

In this paper we discuss four different constructions of vector space 
bases associated to vanishing ideals of points. We show how to compute 
normal forms with respect to these bases and give new complexity bounds. 
As an application, we drastically improve the computational algebra ap- 
proach to the reverse engineering of gene regulatory networks. 

1 Introduction 

Let k[xi, . . . , x n ] be the polynomial ring in n variables over a field k. The 
vanishing ideal with respect to a set of points {pi, . . . ,p m } in k n is defined as 
the set of elements in k[xi, . . . , x n ] that are zero on all of the p^s. 

The main tool that is used to compute vanishing ideals of points is the 
Buchberger-Moller algorithm, described in [2]. The Buchberger-Moller algo- 
rithm returns a Grobner basis for the ideal vanishing on the set {pi, . . . ,p m }- 
A complementary result of the algorithm is a vector space basis for the quotient 
ring k[xi, . . . ,x n ]/I. However, in many applications it turns out that it is the 
vector space basis, rather than the Grobner basis of the ideal, which is of inter- 
est. For instance, it may be preferable to compute normal forms using vector 
space methods instead of Grobner basis techniques. 

A new bound for the arithmetic complexity of the Buchberger-Moller algo- 
rithm is given in [llj . and is equal to 0(nm 2 + min(m, n)m 3 ). We will discuss 
four constructions of vector space bases, all of which perform better than the 
Buchberger-Moller algorithm. An application of the constructions will be that 
we can improve the method of the reverse engineering of gene regulatory net- 
works given in [lOj . 

A key result for the effectiveness of our methods is a fast combinatorial 
algorithm which gives useful structure information about the relation between 
the points. The algorithm uses less than nm + m 2 arithmetic comparisons over 
k. 

As a direct consequence of the combinatorial algorithm, we obtain with 
the same complexity a family of separators, that is, a family {fi, ■ ■ ■ , f m } of 
polynomials such that fi(pi) — 1 and fi(pj) = if i ^ j. It is easy to see that 
the separators form a k-basis for the quotient ring h[x±, . . . , x n ]/I. This will be 
the first construction of vector space bases. 

The second construction is a k-basis formed by the residues of 1, /, . . . , / m_1 , 
where / is a linear form. If k is equipped with a total order, this construction 
uses 0(nm + min(m, n)m 2 log(m)) arithmetic operations Also, we obtain an 
algebra isomorphism S/I = k[x]/J, where J is a principal ideal. 
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The two remaining constructions give monomial Ik-bases. The third con- 
struction we discuss is a method that was introduced in [3j and improved in [B] . 
It produces the set of monomials outside the initial ideal of / with respect to 
the lexicographical ordering, using only combinatorial methods. We reanalyze 
the number of arithmetic operations needed in the method presented in [6] and 
we show that it uses only 0(nm + mmin(m, nr)) arithmetic comparisons (the 
variable r is less than m and will be defined later). 

The fourth construction gives a k-basis which is the complement of the 
initial ideal with respect to a class of admissible monomial orders in a total 
of 0(nm) arithmetic comparisons and additionally 0(min(m, n)m 3 ) arithmetic 
operations. 

In Section^ we end up by giving the biological implications of our construc- 
tions. 

2 Notation and preliminaries 

Throughout the paper, let S — k[x\, . . . , x n ] denote the polynomial ring in n 
variables over a field Ik and let / denote an ideal in S. Whenever / <G S, |/| will 
denote the degree of / and [/] will denote the equivalence class in S/ 1 containing 
/■ 

Let B be any subset of S such that [B] = {[b],b G B} is a vector space 
basis for S/I. If s is an element in S, its residue can be uniquely expressed as 
a linear combination of the elements in [B] , say [s] = Ci [bi] . The S'-element 
^2 Cibi is then called the normal form of s with respect to B which we write as 
Nf(s, B) = By abuse of notation we say that B (rather than [B]) is a 

basis for S/I. 

Let p be a point in k™ and / an element of S. We denote by f(p) the 
evaluation of / at p. When P = {pi, . . . ,p m } is a set of points, we write 
f(P) = (f(pi), ■ • ■ , f(p m ))- If F = {fx, ...,f s } is a set of elements in S, then 
F(P) is defined to be the (s x m)-matrix whose i'th row is fi(P)- 

The vanishing ideal I(P) is the ideal consisting of all elements in S which 
vanish on all of the points in P. Given two elements fi and fa in S such that 
= [/2] in S/I{P), we have fi(p) = f2(p) for all p 6 P. An important 
property of a set [B] of m elements being a k-basis for S/I(P) is that B(P) has 
rank to. 

A family of separators for a set of distinct points is a set {/1, • ■ ■ , / m } of 
polynomials such that fi{pi) = 1 and fiipj) — whenever i ^ j. The residues 
of a family of separators will always form a k-basis for S/I. Such a k-basis 
will have a nice property for computing normal forms and we have the formula 
Nf (/, Sep) = f {p{) •/! + ••• + f(p m ) ■ fm- 

An admissible monomial order is a total order on the monomials in S which 
also is a well ordering. Let -< be an admissible monomial order. The initial ideal 
of/, denoted by in(7), is the monomial ideal consisting of all leading monomials 
of I with respect to -< . One of the characterizations of a set G being a Grobner 
basis of an ideal I with respect to an admissible monomial order -t, is that GCJ 
and that the leading terms of G generate in(I). An old theorem by Macaulay 
states that the residues of the monomials outside in(7) form a k-basis for the 
quotient ring S/I. The set of monomials outside in(7) will be called the standard 
monomials (with respect to -<) throughout the paper. 



2 



We will measure the performance of the algorithms presented by means of 
the number of arithmetic comparisons and the number of arithmetic operations 
(addition and multiplication). We will assume that the cost of an arithmetic 
comparison is bounded by the cost of an arithmetic operation. 

Some of the algorithms we present use comparisons and incrementions on 
the set {1, ... , to}. We call these operations elementary integer operations. The 
elementary integer operations will in general be neglectable and we will, except 
for some cases, omit them in the complexity analysis. 

In the sequel, the word " operations" will mean arithmetic operations and the 
word "comparisons" will mean arithmetic comparisons, if not stated otherwise. 
By "bound" we will always mean an upper bound. 

We do not deal with the growth of coefficients in the operations, but refer 
the reader to [7]. In [I]) the techniques in the case when k = Q are discussed, 
using the Chinese remainder theorem. 

3 Normal form computations for zero dimen- 
sional ideals 

The most frequent method for computing normal forms with respect to an 
ideal / uses the Noetherian property of the reduction process with respect to a 
Grobner basis of the ideal I. However, if I is a vanishing ideal, linear algebra 
techniques are to prefer. Indeed, the reduction process with respect to a Grobner 
basis can have exponential runtime, while the linear algebra techniques have low 
polynomial runtime. On the other hand, the linear algebra techniques do not 
seem to be widely spread and we will describe them here. 

Lemma 3.1. Let B — {ex, . . . , e m } and suppose that [B] is a basis for S/I(P). 
Let 

(/i,...,/ m ) 1 = B(P)- 1 (ei,...,e TB )*- 
Then {/i, . . . , f m } is a family of separators. 
Proof. 

B(P)- 1 (e 1 , e m Y( Pl ) = i?(P)- 1 (e 1 ( K ), • • • , e m ( K )) f 
- b(p)- 1 b(p)(o 1 _ : ^o, 1, 0, . . . , 0)* - (0, . . . , 0, 1,0 0)*. 

2 — 1 times i— 1 times 

□ 

Lemma 3.2. Suppose that [B] is a basis for S/I(P). Then 

Nf(f, B) = ([e x ], . . . , [e ro ])(5(P)- 1 )*(/(p 1 ), . . . , /(p m )) 4 . 

Proof. We have Nf(/, Sep) = (/i, . . . , / m )(/(pi), . • • , f(p m )) t and by Lemma 
O (h,...J m ) = (e u ...,e m )(B-y. □ 

Since evaluation of a monomial of degree d at a point p is done using d 
multiplications, the complexity of evaluating / at the to points uses 0(\f\sm) 
operations, where s is the number of monomials in /. Multiplication by B{P) 
requires an additional number of 0(m 2 ) operations, so we have proven the 
following proposition. 
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Proposition 3.3. Let B = {ei,...,e m } and suppose that [B] is a basis for 
S/I, where I is the vanishing ideal with respect to the points pi, ■ ■ ■ ,p m - Suppose 
that B(P) and the inverse of B(P) have been computed. Then we have a normal 
form algorithm with respect to the separators which runs in 0(|/|sto) operations, 
where f is a polynomial with s monomials. To compute the normal form with 
respect to the basis B , we need to perform 0(\f\sm + to 2 ) operations. 

We can also use the theory of multiplication matrices, described in [4] for 
instance, to compute normal forms of vanishing ideals of points with the same 
complexity as above. The theory of multiplication matrices also allows to extend 
normal form algorithms to general rings S/I, where dimes'/ J) < oo, see for 
instance the Mathphi-algorithm in [7]. 

4 Combinatorial preprocessing of the points 

All of the constructions in Section [5] rely on a combinatorial preprocessing of the 
points that we will described here. We will give the notations and the results 
here, but refer the reader to the Appendix for the algorithmic study. 

Let n be a set equipped with an equivalence relation, denoted by =. The 
equivalence relation on £1 is extended to n-tuples of elements in Q by a = 
(oi, . . . , a n ) — (bi, . . . , b n ) = b if = for all i. The witness of two different 
n-tuples a and b is the least i such that ai ^ 6j. When a = b, the witness is zero. 
Let Tii be the projection map from fi™ to fi* given by (ax, • ■ ■ , a n ) i— > (a\, . . . , a,). 
Let v\ , . . . , v m be n-tuples of elements in and let £ j be the set of equivalence 
classes of iri(vi), . . . , ~Ki(v m ) for i — 1, . . . ,n. To simplify the notation, we will 
represent an equivalence class of tuples as an index set, that is, as a subset of 
{1, . . . , to} instead of as a subset of {vi, . . . , v m }. Using this notation, we define 
£ = {{1, . . . ,m}}. 

Let to be the number of distinct elements in the set {i>i, . . . ,v m }. Notice 
that to = |£ n |. Let W be the witness list - the set of all i, i £ {1, . . . , n}, such 
that £,_i ^ £,. Notice that W is the set of witnesses. Finally, let C be the 
witness matrix - an upper triangular matrix with elements in iyu{0} such that, 
for i < j, the number is the witness of Vi and Vj. 

Example 4.1. In Q = Z, let v x = (1, 2, 0, 1, 1, 0, 3, 5), v 2 = (1,0, 1, 1, 2, 0, 3, 5), 
v 3 = (1,2,0,3,3,1,2,0), Vi = (0,0,2,0,4,0,2,0), v 5 = (0,0,2,1,5,0,2,0) and 
i?6 = (2, 1, 3, 1, 6, 0, 2, 0). We will write the vectors as columns in the left hand 
side of the table below. In the right hand side we write the equivalence classes. 
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£ 6 = 


{{1}, {3}, {2}, {4}, {5}, {6}} 


3 


3 


2 


2 


2 


2 


£7 = 


{{1}, {3}, {2}, {4}, {5}, {6}} 
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£ 8 = 


{{1},{3},{2},{4},{5},{6}} 7 



For instance, {1,3} € £2 shows that p\ and p$ agree on the first two coordinates. 
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We have m = 6, W = {1, 2, 4} and 



C = 
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From the Ej's, we can obtain a tree representation of the vectors. The 
vertices are labelled by the elements in the E^'s and there is an edge from a 
vertex labelled by Ej/. G E^ to a vertex labelled by Ej+^/j G E.; + i exactly when 
Xi+i.h C Such an edge is labelled by Vi+i t j, for some j G Ej+^/j (recall 

that = for all G Ei + ijj). In this way, all vectors and paths 

from the root to the leaves are in a natural one-to-one correspondence. The 
maximal number of edges from a vertex in the tree is denoted by r. In Example 
14.11 r = 3 since Eo has three children. 

{1,2,3,4,5,6} 




Figure 1: The point trie of the first four coordinates of Example 14. II 

Figure 1 shows how the tree representation of the first four coordinates of 
the points from Example 14.11 look like. The authors in [B] call such a tree 
representation a trie. The associated trie to a set of points is a key construction 
in [HI [H] - Since we will deal with two different types of tries in this paper, we 
call the trie that is associated to a set of points the point trie. 

Theorem 4.2. The Ej 's and/or the associated point trie can be computed using 
at most nm + m min(m, rn) comparisons. 

Proof. We refer the reader to the Appendix. □ 
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5 Vector space constructions 



In this section we present the four different constructions. 



5.1 Construction 1 - A separator basis 

Let / be the vanishing ideal of m distinct points p\ , . . . , p m and let C be the 
witness matrix with respect to pi, . . . ,p m - Let 

Q, \\' P - . (1) 

It is easily checked that Qi{pi) = 1 and Qi(pj) = if i ^ j. In this way we get 
closed expressions of a k-basis for S/I as a direct consequence of Theorem 14.21 
We remark that Q is a standard construction of separators. For instance, it 
is used in |10j . but there, the matrix C is computed in a naive way which uses 
0(nm 2 ) comparisons. 

Theorem 5.1. Let I be the vanishing ideal with respect to m distinct points. 
We can compute a set of separators and hence a k-basis for S/I in 0(nm) com- 
parisons and 0(m 2 ) operations overh. We have also a normal form algorithm 
with respect to this basis. To compute the normal form of an element f with s 
monomials, this algorithm runs in 0{s\f\m) operations over k. 

Proof. By definition, Qi, . . . , Q m is a set of separators for the points and hence 
a k-basis for S/I. To get the Qi's is a nice form, we need to evaluate the 
denominators, for which we need 0(m 2 ) operations. 

To compute the witness matrix is 0(nm + min(r7i, rn)) comparisons by The- 
orem Since we assume that a comparison is cheaper than an operation, we 
conclude that we need 0{nm) comparisons and 0(m 2 ) operations to compute 
the Q^s. 

The existence and effectiveness of the normal form algorithm follows from 
Proposition 13. 31 □ 



Example 5.2 ( Example 1 4 . 1 1 continued ) . Consider the points pi, . . . ,p§ as ele- 
ments in Z43. Using we determine the separator Q\ of p%, . . . ,p6 as 

x 2 x 4 - 2 xi - xx - xi - 2 2 

Qi — • • • • — 22xUxi — 2)x2(xa — 2) 

V 2-0 1-2 1-0 1-0 1-2 lV 71 ' 

and, similarly 

Q 2 = 32a^(a;i - 2){x 2 - 2) 2 , Q 3 = 32xl( Xl - 2)x 2 (x 4 - 1), 

Q 4 = 22{xi - lf{xi - 2){ Xi - 1), Q 5 = 22(:ri - l) 3 (a;i - 2)ar 4 , 

Q 6 = ll(xi - lfx\. 

Thus, [{Qi, . . . ,Qe}] is a vector space basis for Z4 3 [xi, . . . ,Xs]/I(P). Let / = 
XiX 2 Xi+X4X5XeX7 . To compute the normal form of /, we evaluate the expression 
on the six points to get f(P) = (2, 0, 24, 0, 0, 2). Thus Nf (/, {Q%,..., Q 6 }) = 
2Qi + 24Q 3 + 2Q 6 . 

Remark 5.3. If Qi = f" 1 ■ ■ ■ f" " is a separator, let Qi = f\ •••/„. Then 
Qi(pj) ^ only when i = j , so Qi/Qi(pi) is also a separator. This observation 
could be used to compute separators of low degrees. 
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5.2 Construction 2 - An isomorphism 



Lemma 5.4. Let be a set and let v\, . . . ,v m be n-tuples with elements in 
Q. Let m denote the number of distinct tuples and, without loss of generality, 
suppose that vi,..., % are distinct. Let W — . . . , in}, be the witness list 
with respect to v\, . . . , v m . Let 7r be the projection from VL n to Q , defined by 
7r((ai, . . . , a n )) = (a^ , . . . , asj w ). Let Wi = n(vi). Then W\, . . . , Wjn are distinct. 

Proof. Suppose that j ^ k and j, k <m. Since Vj and are distinct, there is 
a witness ih G W such that vji h ^ Vki h ■ By definition, this means that Wj and 
Wk differ at position h. □ 

Lemma 5.5. Let {pi, . . . ,p m } be a set of distinct points in k". Let L be the 
vanishing ideal with respect to these points. Let n be any positive integer and 
let 7r be an algebraic map from k™ to Ik™ such that 7r(pi), . . . , ir(p m ) are dis- 
tinct. Let T = . . . and let J be the vanishing ideal with respect to 
7r(pi), . . . ,7r(p m ). Then S/L = T/J are isomorphic as algebras. 

Proof. Let it* be the corresponding monomorphism from T to S defined by 
7r*(/)(p) = /(tt(p)) for / G T. Notice that / G J if and only if /(tt( K )) = for 
all i, which is equivalent to 7r*(/)(pj) = for all i, which in turn holds if and 
only if 7r*(/) G I. This allows us to extend it* to a monomorphism from T/J to 
S/I. Since 7r(pi), . . . ,ir(p m ) are all distinct, we have dimk(T/J) = dim^S 1 /!) 
and, thus, the extension of 7r* is an isomorphism of algebras. □ 

It follows easily that if B is any set such that [B] is a basis for T/J, then 
[7T*(.B)] is a basis for S/I. Let {pi,...,p m } be a set of distinct points and 
suppose that we write the points with respect to the coordinates (aTf, x%, . . . , x n ), 
where xT = giXi + ■ ■ ■ +g n x n and the gi's are generic. Define ir : (a\, . . . , a n ) i— > 
ai with respect to these coordinates. Then the points ir(p\ ),•■•, 7r(p„) will 
be distinct. In fact, we can replace the generic coefficients with elements in 
k, provided that k is large enough. We give two constructions based on this 
observation. 

Proposition 5.6. Let {pi, . . . ,p m } be a, set of distinct points in k™ and sup- 
pose that k contains at least m elements. Let I be the vanishing ideal with 
respect to these points. Then there is an algebraic map tt from k ra to k such 
that 7r(pi), . . . ,Tt(p m ) are distinct and S/I = k[x]/J, where J vanishes on 
7r(pi), . . .,ir(p m ). 

Proof. Let ci, . . . , c m be distinct elements in k. Let {Qi, ■ ■ ■ , Q m } be a family 
of separators for the points and let further 



Then nfa) = c t . Hence, S/I ^ k[x]/J by Lemma EH Now [1], . . . , [a;™" 1 ] 
forms a k-basis for k[x]/J and tt*(x) — J^i c%Q%- It follows that 




m — l 



becomes a k-basis for S/I. 



□ 
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If we assume that k contains at least (™) + 1 elements, then the map w from 
k n to k can be chosen to be a projection, and the k-basis will be of the form 
[1], [x], . . . , [x" 1 " 1 ] with x linear. 

To settle this, we need to introduce some notation. Consider the point set 
{pi, . . . ,p m } in k". Recall that pik — Pjk for all fc < ft if and only if there 
is a set a in such that i, j G a. We say that a vector Vh in k m realizes 
S/j if vm — Vhj if and only if there exists a set a in S/j such that i, j G a. 
For instance, if m = 6 and S h = {{1, 5}, {2}, {3, 6}, {4}}, then (1,2,0,3,1,0) 
realizes S^- When Vh realizes Ef, we say that the type of Vh is S/j. Notice that 
if all points are distinct, then £„ = {{1}, . . . , {to}}- 

Lemma 5.7. Let P = {p\, . . . ,p m } be a set of distinct points in k™. Suppose 
that k contains at least (™) + 1 elements. Then there exists c\ , . . . , Cn € k such 
that all elements in the m-vector c\(pu 11 . . . ,p m ii) + • ■ ■ + Cn{pu W i ■ ■ ■ ,Pmi s _i) 
are distinct, where n < min(m, n) and 1 = i\ < i 2 <•••<««< n. The Ci 's can 
be computed using 0{nm) comparisons and (9(min(m, n)m 2 log(m)) operations 
provided a total order on k. If his not ordered, then we need 0{nm) comparisons 
and 0(min(m, n)m 4 ) operations. 

Proof. Let (ii, . . . ,in) be the witness list with respect to p\, . . . ,p m . We will 
iterate through this list. The idea is to start with a realization i/' 1-1 ) g Z m of 
S ih _ 1 and show that = -yC 1-1 ) + Ch{pi,i h , ■ ■ ■ ,p m ,i h ) realizes S ife for some 
Ch G k. The rest of the proof consists of an algorithm which we call the Distinct 
element algorithm. 

Distinct element algorithm 

At stage 1, let v^ 1 ' = (pu, ■ ■ ■ ,Pmi) and let c\ = 1. 

At stage ft, where 1 < ft < n, suppose that ^C 1-1 ) is a realization of Let 
IT be the set of pairs (j, k) such that j and k are in different subsets of both 
l and the type of {pu h , ■ ■ ■ ,p m i h )- Since h — 1 < n, the number of pairs 
(j, k) such that j and k are in different subsets of T, ih _ 1 is bounded by (™) — 1. 
Thus n = {(oi, h), (a s , b s )} for some s < (™) - 1. Let 

Tj = — for j = 1, . . . , s. 

Pbji h Pdji h 

Let Ch be any non-zero element in k \ {n, . . . , t s } and let 
v^=v^+c h ( Plih ,..., Pmih ). 
At stage n + 1 , we stop the algorithm and return (ci , . . . , c%) . 



The correctness of the algorithm 

We only need to show that realizes Tj ih . For h = 1 this is clear. Pick aj and 
bj in the same subset of £i h . Then aj and bj also belong to the same element 
in Hence, ui' 1 ^ = v^ h ^ and p aj i h = Pbji h , from which it follows that 

Suppose that aj and bj are in different subsets of Y* ih . Suppose further 
that aj and bj are in the same subset of E» h _ 1 . Then Va] ^ — ^ and 
Va 3 i h + Pb 3 t h so that - = c h p ajih - c h p bjih ^ 0. 
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Thus, it remains to check the case when aj and bj belong to different sets 

• V T ji ■ , (h) (h) (h-1) lh-1) . 

m i^i h _ 1 . In this case, we have Va/ ~\— Va 3 - v y b . + c h p aj i h - ChPbji h ■ 
If Paji h = Pbji h , then vi^ - = v ( J l ~ 1] - ^ 0. If p ajih ^ then 

«iy - w 6^~ + c^Pa^h - c /iPfc^h = exactly when 

(h-i) {h-i) 

Cft = — . 

Vbji h Pa-ji h 

However, this can never occur as p aj i h ^ Pbji h implies (a,j,bj) € II and c% was 
chosen to differ from tj . 

The complexity of the algorithm 

Fix a stage h > 1. We construct II as follows. Let L\ be a list containing all 
pairs (j,k) where j and k are in different subsets of Sj h _ 1 . Let Li be a list 
containing all pairs (j, k) where j and k are of different subsets of the type of 
(pu h , ■ ■ ■ ,p m i h ). Merge these lists into a new list L. The elements in II are 
exactly the elements which occur twice in L. After sorting L, we can easily 
obtain II. Note that we use 0(m 2 log(m 2 )) = 0(m 2 log(m)) elementary integer 
operations for this construction. 

Constructing the list (t\, . . . ,t s ) from II requires 0{m 2 ) operations. If k is 
ordered, we sort the list using 0(m 2 log(m)) comparisons. To find Ch, consider 
a list of (™) nonzero elements in k. Take the first element in this list and check 
whether it is in (ti, . . . ,t s ). If it is not, we are done. Otherwise, continue with 
the next element. Finally, after at most (™) checks, we will find an element 
which is not in (ti, . . . ,t s ). Since k is ordered, each check requires 0(log(m)) 
comparisons. 

If k is not ordered, then we can not sort the list, so each check requires 
0{m?) comparisons. 

Thus, we use mostly 0(m 2 log(m)) comparisons if k is ordered and 0(m 4 ) 
comparisons otherwise. Since we repeat the procedure n times, we are done 
with the complexity analysis. □ 

Theorem 5.8. Let P = {pi, . . . ,p m } be a set of distinct points in k™. Suppose 
that k contains at least (™) +1 elements. We give an explicit isomorphism S/I = 
k[x]/J and at-basis for S/ 1 of the form {[1], [/], . . . , [J"^ 1 ]}, where f is a linear 
form. The construction uses Oinm) comparisons and (9(min(m, n)m 2 log(m)) 
operations given a total order on k. Ifk. is not ordered we need 0(nm) compar- 
isons and 0(min(m, n)m i ) operations. 

Proof. By Lemma 15.71 there exists (ci, . . . , c^) such that all elements in the 
to- vector ciipi^, . . . ,p m ii) + ••• + ^(ph-, ■ ■ • ,Pmi w ) ar e distinct. If we let 

it follows that x(p\), . . . , x(p rn ) are distinct. Let J 
be the ideal in k[x] vanishing on x(pi), . . . , x(p m ). The the principal ideal J is 
generated by (x — x(pi)) ■ ■ ■ (x — x{p m )) and a k-basis for k[x]/ J is the residues 
of ,i m " 1 . By Lemma [5.51 k[x]/J = S/I and a k-basis for S/I can be 

chosen as the residues of 1, c\x^ + • • • + CnXi-, . . . , (cix^ + • • • + CnXi-) m ~ 1 . 

The cost of the construction is dominated by the computation of the q's, so 
the complexity result follows from Lemma 15.71 

□ 
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Example 5.9. Consider the points Pi,P2,P3,P4,P5,P6 from Example 14.11 as 
elements in Z43. The witness list equals {1,2,4}, so we get i\ = 1,1% = 2 and 
is = 4. The matrix describing the splittings is 

/ 1 1 1 2 E 1 = {{1,2, 3}, {4, 5}, {6}} \ 

2 2 1 £ 2 = {{1,3}, {2}, {4, 5}, {6}} 

1 2 2 3 S 3 = {{1,3}, {2}, {4, 5}, {6}} 

\1 1 3 1 1 £ 4 = {{1},{3},{2},{4},{5},{6}} / 

where we omit the last two rows of the matrix. The Distinct element algorithm 
is as follows. At stage 1: v\ = (1, 1, 1, 0, 0, 2). At stage 2, we see that the type of 
the second row is {{1, 3}, {2, 4, 5}, {6}}. The set of pairs built from E^ equals 

{(1,4), (1,5), (1,6), (2,4), (2,5), (2,6), (3,4), (3,5), (3,6), (4,6), (5,6)} 
and the set of pairs built from {{1, 3}, {2, 4, 5}, {6}} equals 

{(1, 2), (1, 4), (1, 5), (1, 6), (2, 3), (3, 4), (3, 5), (3, 6), (2, 6), (4, 6), (5, 6)}. 
The intersection is equal to 

{(1, 4), (1, 5), (1, 6), (2, 6), (3, 4), (3, 5), (3, 6), (4, 6), (5, 6)}. 

We compute n, which corresponds to the pair (1,4) and equals n = (v^ — 

v^)/(pu 2 ~Pu a ) = (1 - 0)/(0 - 2) = -1/2 = 21 and similarly for the other 
pairs to obtain 

{ti,...,t 9 } = {21,21,1,42,21,21,42,41,41}. 

We choose c 2 = 2 to get v% — Vi + 2{pn 2 , . . . ,pei 2 ) = (5,1,5,0,0,4), which 
is of type E ia as desired. At stage 3, the intersection equals 

{(1,4), (2, 3), (2, 4), (3, 5), (3, 6), (4, 6)} 

and it turns out that we can use C3 = 1 so that — + (pu 3 , . . . , p 6i . 3 ) = 
(6, 2, 7, 0, 1, 5) which is of type £i 3 = {{1}, . . . , {6}}. The isomorphism 

Z 43 [x]/(x(x - l)(x - 2){x - 5)(x - 6){x - 7)) S Z 43 [xi, . . . ,x 6 ]/I 

of algebras is induced by 

x 1 > c 1 x ll + c 2 x l2 + c 3 x i3 — x\ + 2x2 + x 4 . 
Thus, a vector space basis for Z^xi, . . . , xq]/I can be chosen as 

[1], [(n + 2x 2 + xt)], [(xi + 2x 2 + x 4 ) 6 ]. 
Notice that B{P) becomes a Vandermonde matrix and we have 
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Let / = X1X2X4 + . To compute the normal form of /, we compute 

f(P) = (2,0,24,0,0,2). By Lemma [33 we have 

Nf(f, B) = ([ ei ], . . . , [e ro ])(B(P)- 1 ) i (/(p 1 ), . . . , f(p m )Y. 

Since (B(P)- 1 ) t (2, 0, 4, 0, 0, 2)* = (0, 35, 5, 10, 2, 34)* we conclude that 

Nf(f, B) = 35(xi + 2x 2 + x 4 ) + 5(X! + 2x 2 + x 4 ) 2 + 10(x 1 + 2x 2 + x 4 ) 3 

+2(xi + 2x 2 + x A f + 34(xi + 2x 2 + x A f . 

Recall that there are closed expressions for the inverse of a Vandermonde 
matrix, so Gaussian elimination is not needed to compute B~ l . For reference, 
see for instance [§]. 

Remark 5.10. In practice, the best way to obtain a realization vector v corre- 
sponding to T,n is by nondeterministic methods — check if 

ClipXU ■ ■ ■ ,Pml) H 1- Cn(Pli w , ■ ■ ■ ,Pmin) 

realizes for some pseudo-random elements C{. This will be the case with 
probability close to one. If not, we try with some other coefficients. 

5.3 Construction 3 - Standard monomials with respect to 
the lexicographical order 

It was shown in [3] that it is possible to compute the set of standard monomials 
with respect to the lexicographical order by purely combinatorial methods. The 
authors in [3] presented an algorithm but did not make a complexity analysis of 
it. In [6], it was indicated that the number of comparisons in a straight forward 
implementation of the algorithm is proportional to n 2 m 2 . One of the aims of 
the paper [S] was to improve the algorithm. This improved algorithm consists 
of three steps: 

1. Construct the point trie T\ with respect to x n , . . . , x\. 

2. Construct the lex trie T2 from T\ (see the Lex trie algorithm below). 

3. Return the set of standard monomials {x ai , . . . , x am } with respect to the 
lexicographical ordering with x\ y ■ ■ ■ >~ x n , where {ai, . . . , a m } is the 
set of paths from the root to the leaves in T2. 

Note that the associated point trie is built backwards, i.e. we read the coordi- 
nates of the points from right to left. In the complexity analysis in [6], it was 
shown that the first step requires 0(nmr) comparisons, where we recall that 
r denotes the maximal number of edges from a vertex in the trie. The second 
step requires 0(nm) integer summations, and the third step requires O(nm) 
readings of integers bounded by m. In total, the construction is dominated by 
0(nmr) comparisons. We now improve this. 

Theorem 5.11. We can compute the set of standard monomials with respect 
to the lexicographical order using 0(nm + mmin(m, nr)) comparisons. 



11 



Proof. By Theorem 14.21 it is possible to construct the associated point trie 
using 0(nm + mmin(m,nr)) comparisons. Hence the result follows by using 
the construction of the standard monomials from the associated point trie as 
given in [B]. □ 

For completeness, we will state the algorithm that construct the standard 
monomials from the point trie. For a proof, we refer the reader to [6|. We 
remark that our formulation is in terms of the Ej's. 

Lex trie algorithm (|6j) 

Fix some stage h > 0. Let vq, . . . ,Vj be the set of vertices on level h of the 
trie (at the root level 1, vq = {1, ... ,m}). For an arbitrary equivalence class 
{ii, . . . ,ik} in S n _ft, we let v a ^ = v a ,b U {ik} if ifc £ v a and exactly b elements 
in {ii, . . . , ik-i} also belong to v a . (Initially v a ,b is empty.) The vertex set at 
the (h + l)-th level of the trie consists of all nonempty v a ,b- If v a ,b is nonempty, 
there is an edge between v a and v a ,b which is labelled by b. □ 

Since the paper [Bj does not contain a full example illustrating this algorithm, 
we give such an example here. 

Example 5.12. Let Pl = (l,0,2,l),p 2 = (l,l,0,l),p 3 = (3,0,2,1), p 4 = 
(0, 2, 0, 0), ps — (1,2, 0, 0) and pa = (1, 3, 1, 2). Suppose that we want to com- 
pute the standard monomials of I(P) with respect to the lexicographical order 
with x\ >~ ■ ■ ■ >- x n . First we have to construct the point trie with respect to 
the points read from right to left. The example is constructed to give the first 
four rows from Example 14. 11 that is 

/ 1 1 1 2 Si = {{1,2, 3}, {4, 5}, {6}} \ 

2 2 1 S 2 = {{1,3}, {2}, {4, 5}, {6}} 

1 2 2 3 S 3 = {{1,3}, {2}, {4, 5}, {6}} 

\1 1 3 1 1 S 4 = {{1},{3},{2},{4},{5},{6}} / 

Figure 2 shows the lex trie. The paths from the root to the leaves equals 



1,2,3,4,5,6 




1,4,6 2 3,5 




1 4 6 2 3 5 



Figure 2: The associated lex trie 

(0,0,0,0), (0,0,0,1),(0,0,0,2), (0,0,1,0), (1,0,0,0) and (1,0,0,1). It follows 
that the set of standard monomials is equal to {1, X4, x^, x±, X1X4}. 
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We will now describe the creation of the lex trie stage by stage. 

Stage 1 There is only one vertex on the root level; v = {1, 2, 3, 4, 5, 6}. We iterate 
over the equivalence classes of £4-1 — S3 = {{1, 3}, {2}, {4, 5}, {6}}. We 
start with {1,3} and get woo = {1} and v i — {3} For {2} we get «oo = 
{1,2}. For {4,5} we get v oa = {1,2,4} and v Q1 = {3,5}. Finally, for {6} 
we get w o = {1,2,4,6}. 

Stage 2 We rename the two vertices from the previous stage to wo = {1, 2, 4, 6} and 
i>i = {3,5}. We start by iterating on the equivalence classes of £4-2 = 
£ 2 = {{1, 3}, {2}, {4, 5}, {6}}. For {1, 3} we get v oa = {1} and v 10 = {3}, 
since 1 £ % and 3 <E v\. For {2} we get woo = {1,2}, since 2 6 v - 
For {4,5}, we get woo = {1,2,4} and vio — {3,5}, and for {6} we get 
woo = {1,2,4,6}. 

Stage 3 We rename the two vertices from the previous stage to vq = {1, 2, 4, 6} and 
i>i = {3,5}. On £4-3 = Si, we begin with {1,2,3}. Since 1 G vo, we let 
v oo = {!}• Since also 2 £ w , we put 2 in v i- We have then 3 £ v\, thus 
«io = {3}. We continue with {4,5}. Since 4 £ v , we let woo = {1,4} and 
since 5 £ vi, we let v w = {3,5}. Finally, for {6} we get woo = {1,4,6}. 

Stage 4 We rename the vertices from the previous stage to v = {1,4,6}, v\ — 
{2} and W3 = {3,5}. In E 4 _ 4 = E there is only one equivalence class: 
{1,2,3,4,5,6}. We have: 1 £ v a v oa = {1}, 2 £ v t => v w = {2}, 
3 £ V2 v 2 o = {3}, 4 £ v a => voi = {4}, 5 £ v 3 => v 2 i = {5} and 
6 £ Vq v Q2 = {6}. 

5.4 Construction 4 - Standard monomials for some elimi- 
nation orders 

In this section, we will study a method that can be used to create standard 
monomials with respect to some elimination orders. An elimination order -< 
with respect to the variables x\, . . . , Xi-\ is an admissible monomial order on S 
satisfying the condition 

in(/) £ k[xi,x i+1 ,.. .,x n ] => / e k[xi,x i+1 ,.. .,x n \. 

We will show that using 0(nm) comparisons and 0(min(m, n)m 3 ) operations 
we can compute the set of standard monomials with respect to some elimination 
orders and, thus, for these orders, our method has better asymptotic behavior 
than the Buchberger-Mollcr algorithm when m < n. 

A classic example of an elimination order is the lexicographical order with 
respect to 11 >~ ■ ■ ■ y x n (However, for the lexicographical order, we already 
have a fast method to compute the standard monomials.) 

We will construct an elimination order from two partial orders as follows. 
Let -<i be any admissible monomial order on {x\, x 2 , • • ■ , £i-i} and let < 2 be 
any admissible monomial order on {xi, x i+ i, . . . , x n }. Now define ^ by x a -< x 13 
if x? ■••<« < 2 xf ...xfr or x? ■••<«= xf ...xfr and x" 1 ■ • -x^ 1 ^ 
xf 1 •••a;fr 1 1 . The order -< then becomes an elimination order with respect to 

{xi,X 2 , ■ ■ ■ ,Xi-l}. 

Let {p\, . . . ,p m } be a set of distinct points in k™. Let t be a permutation of 
{1, . . . ,n}. Define r(pi) — (p, r (i), . . . ,Pi T ( n ))- Simplified, this means that r(pi) 
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is pi with respect to the coordinates x T ^, . . . , x r i n y Let W T — {ii, . . . , in} be 
the witness list derived from the S-algorithm with respect to r(pi), . . . , r(p n ). 
By Lemma |5.4[ the points qi,...,q m are distinct, where qj = 7r(r(pj)) and 
7r((ai, . . . , a n )) = (a^ , . . . , a.;_). Let Wf = {j±, . . . ,j„} be the complementary 
set to W T . Let -<i be any admissible monomial order on Xj 1 j ... j Xj ^ • Let ^ 2 
be any admissible monomial order Let B be the set of standard 

monomials with respect to -<2- If -< is the elimination order constructed from -<i 
and -<2, then it is clear that B is the set of standard monomials with respect to 
-< as well. We determine B by the combinatorial algorithm in the case when -<2 
is the lexicographical order. When -<2 is another order, we use the Buchberger- 
Moller algorithm. Except for complexity issues, we have proved the following 
theorem. 

Theorem 5.13. Using the notation above, for any permutation r and for any 
elimination order -< with respect to Xj t , . . . , Xj n , we can determine the set B of 
standard monomials with respect to -< using at most O(nm) comparisons and 
C(min(m, n)m 3 ) operations. If -< is the lexicographical order on , . . . , X{ w , 
then we determine B using at most 0(nm + rnmin(m, nr)) comparisons. 

In both cases, there is a normal form method which can be initiated using 
0(m 3 ) operations. The normal form method uses at most 0(\f\sm-\-m 2 ) oper- 
ations for a polynomial f with s monomials. 

Proof. By Theorem 14. 2 [ it takes 0(nm + mmm(m,nr)) comparisons to pre- 
process the points. The call to the Buchberger-Moller algorithm uses 0(nm 2 + 
mm(rn,n)m 3 ) operations by Theorem 2 in [llj . Since n < min(m, n), the call 
requires at most 0(min(m, n)m 3 ) operations. On the other hand, if we use 
the combinatorial method in the case when -<2 is the lexicographical order, we 
would get 0(nm + mmin(m,Rr)) comparisons as bound. 

Hence, to compute B, we use at most 0(m ) operations and 0(nm) com- 
parisons when -< is not the lexicographical order. When -< is the lexicographical 
order, we use 0(nm + m min(m, nr)) comparisons. The statement about the 
normal form method follows from Proposition 13.31 

□ 

Example 5.14. Let pi,...,pq be the points in Example 14.11 Let t be the 
permutation 

fl 2 3 4 5 6 7 8\ 
^8 2346571/ 

To simplify notation, let j/j = x T u\. We compute the Ej's with respect to 
ys,V7, ■ ■ ■ , yi- Since E 3 equals {{1}, {2}, {3}, {4}, {5}, {6}}, we only display the 
first three rows. 



1110 2 
3 3 2 2 2 2 
1 2 3 4 5 6 



S 1= {{1,2, 3}, {4, 5}, {6}} 
S 2 = {{1,2}, {3}, {4, 5}, {6}} 
S 3 = {{1}, {2}, {3}, {4}, {5}, {6}} 



Thus, W\ = {1,2,3} and S/I is isomorphic to k[j/6i V7-, Vs]/I(Q), where 
Q = {(1, 3, 1), (1, 3, 2), ... , (2, 2, 6)}. Let -< 2 be the degree reverse lexicograph- 
ical order with yg >~2 U7 >~i Us- A call to the Buchberger-Moller algorithm 
gives B^ 2 — {I,ys,y7,y6,y 2 ,yeys}- Let -<i be the lexicographical order on 
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k[j/i, . . . , yg] with yi >-x ••• >-i 2/5 and construct -< from -<i and -< 2 above. 
Then = {1, y 8 , y 7 , y 6 , yj, y 6 ys}- 

Suppose that we want to compute the normal form of / = 2/82/22/4 + 2/42/62/52/7 ■ 
We determine B(t(P))- 1 and (r(/(pi)), . . . , r(/(p 6 ))) = (2, 0, 24, 0, 0, 2). Notice 
that 7"(/(pi»)) = <7(Pi) where 5 = X1X2X4 + X4X5X@X7. The normal form will be 

(l,S8,y 7 ,!/ 6 ,iw 8 )(W)- 1 ) ( (r(/(pi)),..,r(/(p m ))f 

= 12 + 18t/8 + 37j/ 7 + 352/| + 41y 6 y 8 . 

In terms of the x^'s, the order -< is the degree reverse lexicographical or- 
der on k[x5,X7,xi] with X5 >- X7 y x\ and it is the lexicographical order 
on kfxs, X2, X3, X4, xe] with xs y X2 y X3 >- X4 y xq. The normal form of 
X1X2X4 + X4X5X6X7 is 12 + 18xi + 37x7 + 35x^ + 4IX1X5. 

6 Biological implications 

In the algebra approach to reverse engineering, we have some experimental data 
S = {.si, . . . s m +i}, where each Si is a realvalued vector of size n and m <C n. 
Each Sij is then discretized into a prime number p of states so that the s^s can be 
viewed as elements in Z™. For the discretized data, we want to find transition 
functions hi,...,h n such that hi(sj) — Sj+i,j for j = l,...,m. Finally, we 
wish to find the normal form of the hi's with respect to a set B^ of standard 
monomials for I(S), for some admissible monomial order -< on Z p [xi, . . . , x n ]. 
It is easily seen that 

hi = S2,i/l + ' ' ' + Sm+ldfm, (2) 

where fx, . . . , f m is a set of separators with respect to Sx, ■ ■ ■ , s m . 

An example illustrating the method in [lOj is given in the same paper: After 
discretizing over Z3, one has 

Sl = (2, 2, 2), s 2 = (1, 0, 2), S3 = (1, 0, 0), s 4 = (0, 1, 1), s 5 = (0, 1, 1). 

For computing the hi's, the authors use an 0(n 2 m 2 ) algorithm to get hx — 
x 2 x 3 + 2x\ + X1X3 + Xi, hi — 2x\xz + x\ + 2x1X3 + 2xi + 1, /13 = 2x^x 3 + 2x\ + 
2xix 3 + xx + 1. 

Then, the lexicographical order with respect to xi y x 2 y X3 is used to 
determine a Grobner basis for I({sx, s 2 , S3, S4}) by means of the Buchberger- 
Moller algorithm. This Grobner basis is being equal to {x\ + x 2 + 2, X2X3 + X2 + 
2x3 + 2x3, x 2 + X2 + 2xg + 2x3}. Finally, the hi's are reduced using the Grobner 
basis and we get 

m(hx,B) = -x\ + x 3 , Nf (h 2 , B)=xl-x 3 + 1, Nf (h s , B) = -x\ + x 2 + 1, 

where £> denotes the complement to the initial ideal with respect to the chosen 
order. Since the normal form is computed by means of the reduction with 
respect to the Grobner basis, and not by means of Lemma \'6. 21 the worse time 
complexity for this part for general m and n is reported by the authors to be 
0(n(m - i)2 cm +™- 1 ), using the bound in [5]. 

Our approach is the following. Firstly, we determine the set of standard 
monomials of I(S) using the Lex trie algorithm to get B — {1, X3, x|, X2}. The 
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equality S4 = S5 is detected during the ^-algorithm and we need to use only 
P = {s 1 , . . . ,s 4 }. We get 



B(P) = 



(1 1 1 l\ 

2 2 1 

110 1 

\2 1/ 



and £(P)~ 



/0 2 2 2\ 

2 1 

10 2 

\0 2 2 0/ 



By Lemma 13.1 



(/l 1 / ll /8,/4) , = fl(P)- 1 (l 1 l8,4^ 

(2x 3 + 2x\ + 2x 2 , 2x 3 + x 2) 1 + 2^3, 2x 3 + 2xjy. 



Finally, we determine the normal forms of the hi's in terms of the elements in 
B by using (JSJ) : 



Nf (hi, S) = l/i + I/2 + O/3 + O/4 = x 3 + 2a;§ 



and similarly 



M(h 2 ,B) = 1 + 2ir 3 + x\ and Nf(/i 3 , B) = 1 + 2a| + x 2 . 

We will show below that for determining the hi's, it is in general enough 
to use 0(m 3 ) operations. In total, our approach uses O(nm) comparisons and 
0(m 3 ) operations, which is drastically better than the exponential algorithm 
involving reduction with respect to the Grobner basis. Notice that we do not 
use the construction of the separators from Section f5. II That is due to our wish 
to write them as linear combinations of elements in B. 

We are aware of the fact that lexicographical order is not always the best 
choice for a monomial order in these applications. Since m <C n, almost any 
admissible monomial order will be an elimination order and we believe that the 
method in Section [531 can be used in a lot of cases to find a feasible order. 

To complete the section, we state the following general theorem, where the 
complexity results are written assuming that m < n. 

Theorem 6.1. The number of arithmetic operations in our approach to the 
reverse engineering method presented in \10\ is 0(nm) comparisons and 0(m 3 ) 
operations when ~< is the lexicographical order. For the elimination orders in 
Section \5.4\ 0, bound for the number of comparisons is 0{nm) and a bound 
for the number of operations is 0(min(m, n)m 3 ). For an arbitrary order, the 
number of operations is bounded by 0(nm 2 + min(m, n)m 3 ). 

Proof. Except for determining the standard basis B and inverting the 
only necessary computation is determination of the hi's. By © and Lemma 1531 
we have 

hi = (s2,i, ■ ■ ■ j s m+ i t i)B (ei, . . . , e TO )*. 

Thus, computation of each hi requires 0(m 2 ) operations and to compute all 
hi's requires 0(m 3 ) arithmetic operations. 

The theorem for the lexicographical case follows from Theorem 15. Ill In the 
elimination case the result follows from Theorem 15.131 and in the general case it 
follows from Theorem 2 in [TT], where it is shown that the Buchbcrger-Mollcr 
algorithm uses at most 0(nm 2 + min(m, n)m 3 ) operations. □ 
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A Appendix 

We will describe two combinatorial algorithms to perform preprocessing of the 
points. While the first algorithm iterates over the coordinates, the second one, 
given in [B], iterates over the points. However, the two algorithms turn out 
to perform exactly the same comparisons and we prove that the number of 
comparisons that are needed is bounded by nm + mmin(m, nr). 

A.l Preprocessing by iterating over the coordinates 

Here we present an algorithm which computes the Sj's, the witness list and 
the witness matrix by iterating over the coordinates. The number of operations 
of this algorithm is bounded by 0(nm + m 2 ). We will sharpen the number of 
operations in Section IA.3I 

Proposition A.l. Let £1 be a set equipped with an equivalence relation. Let 
v%,... ,v m be n-tuples of elements in Q. The S- algorithm below computes the 
equivalence classes £i, . . . , S n using at most nm + m 2 ft- comparisons. 

Proof. The proof consists of three parts. 
Formulation of the ^-algorithm 

At stage 0, let Wq = {} and let C consist of zero entries only. 
At stage h, let Wh be the witness list with respect to nh(vi), . . . ,irh(v m ), let 
C be the witness matrix with respect to 7th{v±), . . . ,Tth{v m ) and let = 
{E/^i, . . . , S^,fc}. 

At stage h + 1, let Undone be the set of elements in which contains at least 
two elements. Let Done be the set of elements in £/j which contains only one 
element. Proceed as follows. 

Pick a set T from Undone and let Undone = Undone \{T}. Let i be the first 
element in T and let T\ be the set of indices j in T for which Vi^h+i ^ Vj t h+i- 
Let T-i = T\ T\ and Done = DoncU{T2}. If T\ contains exactly one element, 
let Done = DoneU{Ti}. If T\ contains more than one element, let Undone = 
Undone U{Ti}. Also set c^n{i,j),rna3L,{i,j) = h + 1, for all i € T2 and all j € T\. 
Repeat until Undone is empty and finally let = Done. If at least one 

T\ was non-empty during the process, let Wh+i = Wh U {h + 1}. Otherwise, 
let Wh+i = Wh- Undone will eventually get empty since we remove a set T 
from Undone in each step described above, and in the cases when we insert an 
element, this element will have lower cardinality compared to the set that we 
removed. We stop the algorithm either when S^_|_i contains no elements with 
more than one element or after performing the nth step. If we stop at stage 
h + 1, we set W — Wh+x and = S^+i for i = h + 1, . . . , n. 

The correctness of the algorithm 

Clearly So = {{1,2, .. . ,m}} and Wq = {} agree with the assumptions made 
at stage h — 0. After stage h + 1, we also see that contains disjoint 
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subsets. Suppose that we pick two elements i and j from different subsets of 
S/i+i and suppose that Vik = Vjk for k < h. Then i and j are in the same 
equivalence class of S^, and are splitted in stage h + 1. Thus v^h+i i= Vj t h+i 
and Cij = h+l. Suppose that we pick two elements i and j from the same subset. 
Then u^fc+i = t'j./i+i and by assumption, Vik — Vjk for fc < h, so we conclude 
that Vik = Vjk for ell k < h+l and, hence, Cij — 0. Thus the assumptions made 
at stage h hold also for stage h+l. Besides from the complexity, the correctness 
of the proposition now follows by performing the algorithm to stage n. 

The complexity of the algorithm 

We will split a set T into two sets T\ and were T± is non-empty, at most 
fn — 1 times. Every time we split, we will perform at most m comparisons, 
resulting in a bound of m 2 comparisons. At each stage there are at most m 
comparisons resulting in a non-splitting. At most n times we will not perform 
a splitting of T. Still, we need to perform m comparisons in order to make sure 
we do not need to split, resulting in a bound of nm comparisons. Thus, the 
overall upper bound is nm + m 2 comparisons. 

□ 

Remark A. 2. It is clear that the number of elementary integer operations for 
the construction of for W and C is 0(n) and 0(m 2 ) respectively. 

Suppose that Q is equipped with a total order and suppose that v\, . . . , v m 
are sorted lexicographically with respect to this order. Then, if Vh,j 7^ Vhj+i, we 
know that Vhj ^ Vh,j+2, Vh,j 7^ v h,j+3 an d so on. For every stage h, we need to 
perform at most m comparisons, thus we can compute the Sj's using only 0(nm) 
comparisons. Since the complexity of sorting vi, ■ ■ ■ ,v m is 0(nmlog(m)), we 
have the following proposition. 

Proposition A. 3. Suppose that Q is equipped with a total order. The Sj 's can 
be computed using O(nm) comparisons if the Vi 's are sorted and 0(nmlog(m)) 
comparisons otherwise. 

Remark A. 4. In the case when = 7L V and p is less than log(m), it may be 
useful to sort the vectors using bucket sort instead of the classical merge sort. 
The complexity for the sorting step then becomes 0(nmp). 

A. 2 Preprocessing by iterating over the vectors 

The second algorithm was first formulated in terms of the point trie [ 6J . The 
algorithm iterates over the vectors, assuming that a partial trie exists and inserts 
a vector into it. The number of comparisons that are needed was reported to 
be bounded by nmr, where we recall that r denotes the maximal number of 
edges from a vertex in the tree. In Section IA.3I we will sharpen this bound. We 
formulate the Point trie algorithm in terms of the E, 's to simplify the comparison 
of the algorithm with the S-algorithm. We omit the bookkeeping of the witness 
list and the witness matrix since this was not part of the original Point trie 
algorithm. 

The Point trie algorithm 

Let fi be a set equipped with an equivalence relation and let v\ , . . . , v rn be 
elements in f2™. 
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At stage h, suppose that is a trie with respect to vi,...,Vh- Let 

T^i^, . . . , £„ be the equivalence classes defining T^ h \ To construct the trie 
rp(h+i) ^ chgck if Vh+1.1 = i>j,i for some i < ft by iterating over the equivalence 
classes in Y,[ h \ 

• If it did not, let = Sf 5 U {{/i + 1}} for i = 1, . . . , n and stop. 

• If it did, then i G E^j 1 for some j. Let £} £~ = for fc ^ j and 
let = S^j U {ft + 1}. Continue to check if = ^i,2 for some 
z G Y,[ h j , by iterating over the children of £2 • 

- If it did not, let £<' l+1) = £^ y {{ft, + 1}} for i = 2, . . . ,n and stop. 

— If it did, then i G £ 2 ^ for some j. Let S^fc" 1 ^ = ^ife ^ or ^ ^ j and 
let £ 2 'V" 1 ^ = £ 2 j U {ft + 1}. Continue in the same fashion. 

□ 

Remark A. 5. It was indicated in Jf^ that the assumption of being equipped 
with a total order makes it possible to create the point trie by iterating over the 
points using 0(nm\og(m)) comparisons. We do not agree with the argument 
given in It would prove that insertion sort has complexity 0(m log(m)) (the 
algorithm is insertion sort when n = 1), which is a contradiction. It is not hard 
to prove that the correct bound should read 0(m 2 +nmlog(m)) for this method. 
However, if we assume that the points are sorted from the beginning, then we 
can manage in 0(nm) operations. 

A. 3 Comparing the preprocessing algorithms 

We developed the £-algorithm, described in lA.li as an effective way to build 
the witness matrix and the witness list and we had the constructions from 
Section 15.11 and Section 15.41 in mind. Later we realized that the Ej's could 
be used in Section [5^1 When reading the paper [3], we understood that the 
£-algorithm could also be used to improve the combinatorial computations of 
standard monomials with respect to the lexicographical order. It turned out 
that it was not obvious that our method was to prefer. Indeed, when nr <C m, 
the Point trie algorithm seemed to have better asymptotic behavior. This lead 
us to make an extensive comparison of the algorithms, and it turned out that 
the two algorithms perform the same comparisons! A corollary to this is that 
both algorithms share the upper bound 0(nm + mmin(m,nr)). 

Proposition A. 6. The £— algorithm and the Point trie algorithm perform the 
same comparisons. 

Proof. Consider first the £-algorithm. Fix an element Vij, with i G Ej-i.fc. 
Then is compared only with elements Vhj, with ft G Ej-i.fc. More precise, if 
h < i, then is compared with Vhj if Vfj ^ Vhj for ft' < ft. If ft > i, then 
is compared with Vhj if Vf j ^ v^j for all ft' < i. 

Now consider the Point trie algorithm. Upon insertion of the vector u$ into 
the partial trie T^ _1 \ the element v^j is compared with elements Vhj, with 
ft G £!Cj fe- But is also compared with elements v^j for ft > i, when Vh is 
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to be inserted into T^ 1-1 ). Consider the first group. We compare Vij with Vhj 
when Vh'j ^ Vhj for all h! less than h. In the second group, is compared with 
Vhj when h > i and if Vhj ^ v^j for all h' < i. 

Hence, the two algorithms perform the same comparisons. 

□ 

We can now prove Theorem l4.2l 

Proof of Theorem \4-2\ By Proposition IA.1| the X-algorithm uses at most 
nrn + m 2 operations. By [6], the Point trie algorithm uses at most nmr com- 
parisons. The result now follows from Proposition I A. 6l □ 

Since it is not possible to know the value r a priori, it is not clear whether 
we should use the method from Proposition I A . 3 1 or the S-algorithm in the case 
when O is ordered and nlog(m) < to 2 . It actually depends on the configuration 
of the points. 
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